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Research and Evaluation in 
Urban Educational Policy 

Michael H. Kean 



INTRODUCTION 

Urban school district-based research and evaluation 
offices have grown rapidly, almost uncontrollably, since 
the advent of the Elementary and Secondary Education Act 
of 1965. The view that evaluation, as the process of pro- 
viding information for decision makers, is vital to effective 
school system administration has developed simultaneously 
with increasing Federal involvement in education, particu- 
larly in urban areas. Although the overall recognition and 
expansion of the roles of educational research and evalua- 
tion sho»'^ viewed positively, such rapid development 
does not take place without complications. 

Offices of research and evaluation should function as 
service agencies that aid dec is ion -making and advance in- 
structional practices in school districts. The provision of 
information, whether of a contextual, formative, or sum- 
mative nature, presupposes that the information will be at 
least potentially useful in terms of educational policy. 

The focus of this paper will be upon the identification 
and exploration of certain subliminal factors, and the inter- 
relationships between them, which may ultimately account 
for the translation of research and evaluation findings into 
policy. 

Three major sections follow this brief overview of the 
paper's structure In the first, an actual case will be pre- 
sented as a subject for analysis. Of particular importance 
to the focrs of this paper is the impact and degree of accept- 
ance, both nationally and locally, of the study discussed 
in this section. It is this acceptance that relates directly to 
the trriia tion of the study's findings and suggestions into 
schooi district recommendations and policy decisions. 

The section dealing with Analysis will attempt to ex- 
plore why this particular study had great impact, while 
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other, earlier ones, did not Finally, factors leading to policy 
decisions will be explored in the concluding section. 

WHAT WORKS IN READING?— A CASE STUDY 
Background 

The rrsults of What Works in beading? (a joint School 
District /Federal Reserve Bank empirical sfidy in Phila- 
delphia) were released in June of 1979. Though contro- 
versial, the study has sparked an enormous amount of na- 
tional interest and attention. The purpose of this study was 
to determine what makes a difference in teaching children 
to read. 

The study had its genesis in two independent efforts 
by the School District of Philadelphia and the Federal 
Reserve Bank of Philadelphia. As part of its ongoing re- 
search and evaluation activities, the Office of Research and 
Evaluation of the School District of Philadelphia had con- 
ducted several studies of reading practices in recent years. 

At the same time, the Federal Reserve Bank of Phila- 
delphia was conducting a study of its own. In 1975, it pub- 
lished a study of achievement grow|h in the Philadelphia 
schools, which utilized econometric techniques (Summers 
and Wolfe, \915y. This effort was reviewed extensively, 
especially by economists, but was criticized from within 
the School District of Philaoelphia. Objections were raised 
on both technical and social grounds. After a period of 
heaftd interactions, it became evident that the School 
District had no intention of utilizing this study for policy 
developmert or decision-making purposes. 
q In late October of 1975, the Superintendent of Schools 
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of Philadelphia and the President of the Federal Reserve 
Bank of Philadelphia were invited by the Deputy Mayor 
of Philadelphia to meet with him tp discuss the recently 
released Federal Reserve Study. An agrecmen: was reached 
whereby the Office of Research and Evaluation of the 
School District and the Research Department of the Federal 
Reserve Bank would meet to discuss the development of 
a followup ^tudy utilizing, as a base, the methodology 
employed by the Federal Reseive Bank, but integrating 
within it the concerns and learning priorities of the School 
District. Shortly after this meeting at City Hall, the Execu- 
tive Director of J«! Office of kesearch and Evaluation and 
the Research Officer and Economist of the Federal Reserve 
Bank met to discuss the possibilities for a new study. 

Key staff members from both the Federal Reserve 
Bank and the School District met, in a series of half-day 
work sessions to plan the study. At the outlet, the tone 
was cordial but guarded, and the meetings were negotiating 
sessions as much as planning meetings. Reasons for earlier 
disagreement quickly became evident. The nature of various 
school variables had to be clarified. In addition, differences 
in statistical terminology were a barrier. At one point, a staff 
member familiar with both multiple regression analysis 
and ^nalysis of variance was brought in jo "translate" 
the terms and concepts used. As the work sessions pro- 
gressed, they brought with them a heightened awareness 
of each other's world. Eventually, a genuine mutual respect 
developed. Given what had occurred in the past, this under- 
standing and regard were sine qua non for the implementa- 
tion of this Mudy. 
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Overview of the Study 

Some schools arc more successful than others in terms 
of reading achievement growth t'om one year to thf next, 
and in terms of annual level of achievement. Why does 
one school have a higher- score than another? Why do some 
students perform better than others? By collecting measures 
of possible reasons, one might be able to discriminate 
among reasons by virtue of their degree of association 
with the measure of success. In short, it is possible to com- 
pile the multiple regression between the achievement 
measure (the dependent variable) and the estimated mea- 
sures of the hypothesized reasons (the predictors or inde- 
pendent variables) 

This study was a search for those variables that are 
associated with changes in achievement- growth, and an 
attempt to describe the associations in terms of socio- 
economic conditions, educational inputs, and peer group 
characteristics. Ine cliche "correlation does not mean 
causation" is an appropriate caveat. However, in the world 
of educational policy, decisions must be made on the basis 
of the best available information. Therefore, policy impli- ^ 
cations were the end product of this study 

The rationale for the study was based in part on the 
notion that addng to the existing txxiv of knowledge con- 
cerning successful practices in reading was only partially 
useful. The wealth of research in reading has resulted in 
the layering of both old and new ideas upon one another. 
Little attention has been paid to removing the irrelevant 
or unproductive Since such excess baggage is often detri- 
mental "to instruction and costly in terms of resources. What 
Works in Reading 9 attempted to identify variables that both 
did and did not make a difference in reading achievement 
Schools were picked for the study by rank-ordenng 
all elementary schools by their overall average reading 
scores (1975, grades 1-4) and their overail gain scores 
(1974-1975, grades 1-4) in reading. Ten schools at the top 
of both lists and ten at the bottom of both lists were selected. 
Five schools in the middle of both lists completed the 
sample of 25 schools 

Though pupils :n this study were from the 25 selected 
schools, the study involved facts about individual pupils 
it wss the individual pupil who was the subject of this 
study All of the fourth grade pupils in the schools selected 
were in the study Fourth grade was chosen because it is 
the grade in which a large drop in test scores is typically 
observed; it is the highest grade which is found in all 
v elementary schools; and the ability to read at that grade 
is importantly related to a student's subsequent progress. 

Information was gathered for the study by teams 
nade up of the staff of the Of*ce of Research and Evalua- 
tion and of the Division o, English /Reading Language 
Arts Education These teams visited the schools involved 
and interviewed the principal, the teachers, the reading 
teachers, and the' reading aides. A total of 25 principals, 
25 reading teachers, 94 classroom teachers, and 68 reading 
aides were mterviewed. In addition, team members gathered 
large amounts of information from each pupil's records. 

All of this information was checked and double-checked 
for accuracy and then placed on a computer file. One hundred 
sixty-two variables about each of the 1,828 pupils made 
up the computer file on which the study was based. Later, 
various combinations of these separate items of information 
increased the total number of variables about each pupil 
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variables a>out the principal of the pupil s school, variables - 
about the reading teacher in the pupil's school; variables 
about the pupil's classroom teacher, variables about the 
pupil's school, and variables about the individual school. Once 
all Of the information about each pupil was placed on computer 
tape a random sample of 25 percent of the pupils was removed 
from the file and put aside. This was kept as a cross-validation 
sample, which allowed the results to be double-checked. 

Once all of the information about each pupil was 
placed on computer tape, a random sample of 25 percent 
of the pupils was removed from the file and put aside. This 
was kept as a cross-validation sample, which allowed the 
results to be double-checked. 

Over 500 multiple regression equations were run on 
the large (75 percent) file This involved trying out mfcny 
different combinations of facts (equations) about the 
, pupils in order to determine which combination was most 
closely related to gains in reading scores After the equation 
that seemed to be most closely related to gains in reading 
scores was found, it was used on the cross-validation 
(25 percent) file. Findings that were the same in both cases 
- could be reported with some confidence, those that were 
not, could be presented for discussion and further study. 

The Study's Impact 

The very day the study was presented at a public 
Board of Education meeting in June of 1979, it began 
making news. Though purely of local interest at first, it 
was the subject of'a wire service story featured in the 
Los Angeles Times the following week. By mid-summer, 
over a thousand inquiries had been received. 

Local television and radio stations broadcast stones 
on the results of the study. The three major daily^metro- 
pohtan newspapers publi&hed extensive stones, each 
focusing on a somewhat different aspect of the study, but 
all covering the major findings. Following the in.jal local 
coverage and the AP wire story, a number of maw educa- 
tional penodicals reported the study's results. By the fall, 
over five thousand inqu'nes had been received 
r Perhaps the major impact of the study, however, was 
the appearance of a document entitled A Blueprint for 
Academic Achievement The Bl"*print, as the document 
came to be known, was a 22-page draft document trans- 
mitted by the Supenntendent of Schools to his Executive 
Cabinet for review, discussion, and refinement. The 
Blueprint was developed largely as - result of a charge to 
the School District's Office of Curriculum and Instruction 
to study "the problems of raising achievement, particu 
larly in schools with greatest need" Unbeknownst to the 
authors of What Works in Reading? the report of the Curncu- 
lum Office was integrated with the research study by other 
members of the Superintendent' s staff. The result was an 
unsuspected though pleasant surpnse to the researchers, 
for the Blueprint had, indeed, drawn heavily upon their 
work. In his introductory memorandum, the Supenntendent 
stated: 

. I have read in-depth the research report, what Works 
in Reading? I believe it can prove to be one of the most 
significant reports on reading achievement in the recent 
h?story of public education, and I have included several 
of its recommendations in this document (1979 3) 

Actually, ten,o£ the Blueprint s 36 specific recom- 
mended actions flowed directly from What Works in 
Reading? with an equal number at least tai gentially related 
to the study. 



ANALYSIS 

As demonstrated in the previous section, What Works , 
in Reading'* was not just another piece of research Unlike 
many studies that are politely accepted and then shelved to 
gather dust, this study has already had an impact The 
extent of that impact and the ultimate level of. utilization 
remain to be seen It is evident, however, that What Works 
tn Reading'* has succeeded as a catalyst for change where 
other such efforts have failed Why ' ^ 

There are a number of possible answers to that question, 
with no single explanation alone accounting for the differ- 
ence My own participation in the study and in the process 
of its explanation and implementation lead me to suggest 
four possible reasons for the study's impact ( I ) it maximized 
outside involvement while establishing internal ownership. 

(2) it took a proactive approach to planning for change^ 

(3) it attempted to minimize' resistance to change, and 

(4) it attempted to build upon factors associated - with 
research utilization 

Ownership 

From the outset, great care was taken to establish the 
study as one undertaken by the School District with assist- 
ance^ from the Federal Reserve Bank In spite of its potential 
utility, the bank's previous study had virtually no local 
impact because it was viewed as the work of "outsiders." 
unfamiliar with both education and the school system. The 
problems encountered in that first study were aptly sumftied 
up in an Inquirer feature on the role of the "outsider" 
economist. 

That report was attacked trom all sides She was an 
outsider, her studv uninvited "What I learned." 
Ms Summers says, "was when you come a^ a to4al 
outsider to the system. ^ie wall is nearly impenetra- 
ble People coalesce againsMhe outsider ' (June W. 1979) 

In order to avoid the problem. Kcan and Summers 
carefully planned the nature of the cooperative effort that 
was to ensue Not only* was the study's ownership to be 
t associated with the School District, but- the District s Office 
of Research and Evaluation took great care to involve other 
key individuals and organizational divisions as well 

The Office of Curriculum and Instruction, particularly 
its* Division of Reading/ Ei.gltsh Language Arts, were 
heavily involved The Associate Superintendent toi Curricu- 
lum and Instruction and the Executive Director for Reading/ 
English Language Arts actively participated in the formu- 
lation of the problem anil the preliminary study design 
As the work progressed, the Division of Readmg/Erglish 
Language Arts became even more involved, with its Execu- 
tive Director and several of her key assistants playing major 
roles in identifying the critical variables to be studied, 
designing the instrumentation, aod belptng to define the 
parameters of the effort 

The actual data collection procedures were coopera- 
tively handled by supervisory staff members of both the 
Office of Research and Evaluation and the Division of 
Reading /English Language Arts The nature of such a 
joint endeavoi "a*na/cd (he former "outsider," according 
to the Inquirer 

Ms Summers was ama/ed by the ease of gathering data 
this time h>r her earlier study Ms Summers "went 
up and uown. knocking on school doors, asking tor 
the data and getting stonewalled all along the way lhat 9 
data came from sweat lots of sweat " It took her a year 
Q and a hall to get the facts 
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This time, it took the school distrfct three weeks "I 
almost fainted;* said Ms Summers (June 30, 1979) 

A final collaborative effort took place shortly before 
the results wfife^ publicly released The Associate Superin- 
tendent for Curriculum and Instruction and the Executivr 
Director of Rekhng/ English Language Arts and her sta f 
were provided wjth draft copies of the report and aske ■ 
to review them Their comments were shared during the 
course of two face to-face meetings, and in virtually all 
instances their suggestions were integrated within the text 
of the final document 

Hence, the ownership of the study could be truly 
ascribed to both the School District's Office of Research 
and Evaluation and the office responsible tor the program- 
matic area (reading) being examined 

Proactive Planning 

The approach discussed in the preceding section is 
exemplary of the proactive approach to planning associated 
with the study "Proactive" is used in contrast to "reactive " 
A common misconception is that planning, by its very 
nature, must be proactive The fact is, however, that *i 
considerable amount of planning is undertaken in response 
to stimuli rather than tor catalytic purposes The proactive 
approach to planning anticipates the reaction to a situation 
and develops a desirable positive alternative response to it 
The principal architects of the What Works in Reading' 
study attempted to employ a proactive approach to planning 
from its outset 

A variety of potential problems were identified during 
the course of the authors' initial meetings, and each was 
dealt with as if the success of the entire study depended 
upon its resolution A host of problems were identified 
Areas ranging trort. finances, scheduling, and personnel 
allocation, to political reaction, protocol, and techmca 1 
verification were all considered In the end. this attention 
to detail seemed to produce handsome results 

Perhaps most crucial was the attention paid to the 
planning of the release of the studv's results Here the 
"outside" partner in the study— the Federal Reserve 
Bank - was used as a neutral party in convening a prc->N 
briefing prior to the formal public presentation The Supei- 
intendent of Schools had. of course, already been bncfed. 
and the Mudy had been placed on the agenda of the meeting 
of the Board of Education to be held the following Monday 

The education writers of the city's major newspapers 
and all-news radio stations were invited to a luncheon at 
the Federal Reserve Bank, so were members of the news- 
papers' editorial boards The study was presented carefully 
and non-tcchmcally . with no limit on the time taken to 
answer questions Each person present had agreed in advance 
to a "gaiz rule" until after the study was released publicly 
Copies of Ihe study were distributed, and all participants 
departed from the briefing tar more knowledgeable than 
they would have been had they merely heard What Works 
tn Reading' reviewed at a public Board of Education meet- 
ing Each member of the fourth estate also had three days 
to review the document and to prepare a story for "immedi- 
ate* ' release the following week < 

The results were gratifying, both in terms of coverage 
and accuracy A particular dividend was the editorial 
attention paid to the study, and the support provided by the 
editorial writers The hoped-for results were, indeed, 
achieved 
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Minimizing Resistance 

Resistance to change was identified in a previous 
section of this paper as a force to be contended with in 
planning for the translation of research and evaluation 
results into educational policy initiatives. The ownership, 
involvement, and communications strategies already de- 
scribed in this section doubtless helped serve to reduce 
some of the expected resistance Two other related ap- 
proaches may have also had a positive effect. 

Almost immediately following the formal pu bllc K ~ 
leqse of the study, its principal authors began making pre- 
sentations to a large number and variety of audiences. In 
addition, in-depth central office discussions were initiated 
The Superintendent of Schools had promised 'at the time 
of the study's release to appoint a select committee to con- 
sider follow-up action. Close coordination between the 
Superintendent s Office and the Office of Research and 
Evaluation resulted in the appointment to the Committee 
of a broadly representative group of individuals. Organiza- 
tions such as The Home and School Association, the Council 
of District Superintendents, Association of School Admin- 
^ istrators, Federation of Teachers, as well as key program- 
matic and supportive service personnel, formed the nucleus 
of the committee. Though the group has moved slowly in" 
considering thfe mynad options before it, its work has been 
both deliberate and productive. 

The authors of the study attempted to be just as delib- 
erate lfi their attempt to minimize the technical condescension 
and egocentric prescription that eo often permeate major 
studies" They indicated that the findings presented were 
the ones that seemed most petinen;, and on which it was 
possible fur the school system to take action. The findings 
were the result of intensive investigation using sophisticated 
mathematical techniques As such, it was suggested, they 
should certaifiry-be. given serious consideration and thought, 
but should not be regarded as ,>anae8as. y 



Figure 1 

The congruence between Bnckell and Aslaman's recommendations tor 
the communication of research data *nd 'fv. reporting of the results of 
What Works tn Readmy ' 



Brickel! and Asianian's 
" Recommendations 

Brevity 



Placing most technical 
material in appendices 



Timelines with re* peel 
to decision makers 
expectations 

t se nt entirely non 
technical language- 



Provision of public 
presentation material :<> 
ampli'y cuCwUlivc summary 



Reporting the Results of What 
Works in Reading? 

8-page Sumnjvy using bullets to 
highlight major points, plus 4 page 
Digest of Results listing findings 
according to each sector 

Regression results and means and 
standard deviations included in tables 
at end of report Separate Technical 
Report to answer technical questions 
and concerns 

Information released according «o 
specific planning and decision making 
needs of top administration 

beonomctne and educationcse 
"translated into language under 
standable by lay and professional 
personnel alike 

Copies of summary, instcnl of large 
graphics, disseminated at outset 
of each pub'ic presentation 



Utilization Factor 

One of the principal foci of this paper is the question, 
why do certain research and evaluation reports have impact 
upon decisions while others do not ,} Bnckell and Aslaman's 
re&ommendatioas for the communication of research data, and 
those of Alkin ct al. on factors affecting utilization, seem 
to apply to this case study Though no attempt was made 
to tailor the means of reporting the study's results to fit 
Bnckell and Aslaman's recommendations, the level of 
congruence is remarkable, as detailed in Figure 1 

The senes of eight factors affecting utilization cited by 
Alkin ct al also bears a high degree of simtknty to the 
concerns taken into consideration by the researchers in 
planning, implementing, and disseminating the results of 
the study. The foregoing discussion of ownership, proactive 
planning, and minimizing resistance to change demonstrates 
the attention paid to I) setting pre-defined boundaries. 
2) onenting informatioi&isers, 3) the approach of the study 
team. 4) the study team's credibility. 5) organisational 
structure and relationships, 6) contextual /environmental 
forces. 1) report content and style, and 8) the needs and 
expectations of decision makers 

CONCLUSIONS 9 

Examination of this topic, with its descnptive case 
study and analysis, has generated ten over-all factors 
associated with the translation of research and evaluation 
into educational policy These ten factors certainly do not 
compnse a finite listing, they relate to the case studied 
here, but may not necessarily apply to all similar situations 
Perhaps even more important, this listing may well represent 
only a fraction of the total range of such factors The ten 
general areas are as follows: 

1; Identification of Clients It is important to single out 
the specific clients and client groups who are most closely 
associated with the research being undertaken and most 
directly affected by any policy decisions likely to be devel- 
oped as a result of that research The expectations of the 
clients, as well as the type of information and service* they 
require, are important considerations in focusing the research 
and evaluation process 

2 Vitality of the Topic. There arc a great many topics 
whose thrust is sr tangential to the so'ution of a particular 
problem that they will seldom generate very much interest. 
A topic directly related to a highly visible problem may 
virtually insure that the results t>f the study of that iopic will 
be carefully considered. In framing a topic for study, cntena 
such as importance, visibility, acceptability, and under- 
standability should be reviewed 

3. Participant Involvement This factor relates directly 
to the previous discussion ot ownership It is important to 
involve as many as possible of that groups who will likely 
be ultimately affected by the study. Involvement should be 
genuine, not merely "windov* dressing " Though this may 
lengthen the period of the study, it will pay handsome divi- 
dends in the long run. 

4. Technical Quality The technical aspects of the study 
On terms of research methodology, appropriate measurement 
techniques, and careful reporting) must be beyond reproach 
Wherever possible, the stud) should improve upon previous 
major works in the area In addition, the use of multiple 
measures will greatly er l ance the study*s acceptability 

5 Reporting Formats A variety of reporting formats 
is very necessary if a study's results are to be adequately 
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communicated. Since most decisions are made by laymen, 
the basic* report should be as nontechnical as possible and 
snould always include an executive summary and/or 
abstract In addition, an illustrated, popularized version 
tends to be very useful in communicating with the public 
at large, as is the use of multimedia materials such as slides, 
large graphics, etc A full technical report should be available 
for that s nail group of individuals interested in the technical 
specifics of the study 

6 Findings Keyed to (he Decision Process Timing 
is all-important if research and evaluation results are to 
have genuine impact upon policy In order to perfect such 
timing, it may be useful to attempt to determine the type of 
decisM ns likely to be made as a result of the study When- 
ever possible, a study's results and recommendations for 
policy should relate to the general context of the school 
system and should be demonstratively cost effective and/or 
cost efficient 

7 Preparation of Policy Makers Advance briefings 
tor key decision and policy makers are of tremendous value 
Briefings should include a nontechnical overview of the 
specific results of the study, the relationship^ those results 
to the needs of the system, and the specific implications 
for policy that seem to spring from the study Those studies 
actually "commissioned" by decision makers probably 
stand the greatest chance of ultimately having an impact 

8 Overcoming Resistance The ability of the study 
team to anticipate potential problems resulting from their 
work will help reduce resistance The degree to which re- 
sistance can be dealt with prior to its surfacing will, in the 
long mi*, minimize disruption of both the implementation 
of the study and the translation of its results Lito practice — — 

9 The Roie of the Ombudsman The designation of 
a member of the study team as ombudsman or trouble- 
shooter during the study's implementation will help reduce 
both resistance and misunderstanding Such an individual 
should initiate dialog, not wait for problems to occur The 
ombudsman should attempt to work with clients prior to, 
during, and after implementation of the study 

10 The Role of the Entrepreneur Finally the entre- 
preneurial role is arr important correlate of policy decisions 
This role may be played by either the mdividual(s) responsible 
for pnklucing the research and/or evaluative information 
or the decision maker ultimately responsible f^r translating 
it into policy and acting upon it If the policy maker exhibits 
entrepreneurial behavior, the researcher s role is consider- 
ably simplified Since this is not typically the case, however, 
it is the potential impact of the researcher's entrepreneurial 
acumen that w;ill be considered here 

Within the discipline of economic development, the 
entrepreneur is an individual who applies a new combination 
of resources and technology in productive activity to effect 
change The resulting change, however, is rarely only 
economic It is social as well, for economic change does 
not occur without serial ramifications There is a great deal 
of similarity between the roles and characteristics of the 
entrepreneur and the change agent By either classification, 
such an individual has been the key figure in originally 
unlocking the doors of development in many of what arc 
thought of today as the world's most progressive nations 
The entrepreneurial role lynot only appropriate, but ex 
tremely useful in working mward the acceptance of research 
information and ultimately translating it into policy In play- 
ing the role of the entrepreneur, the researcher cannot 
assume a neutral posture He must, in fact, b: a strong 
O 
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advocate of the utilization of the information he has devel- 
oped and should approach his task with an eye toward its 
translation into policy from the outset It is important to 
remember that advocacy of the utilization of data need not , 
compromise objectivity in the conduct of research or 
evaluation. r, 

McClelland has suggested that "The successful entre- 
preneur . . is by definition someone who considers alter- 
natives and consequences before they actually happen to 
him" (McClelland 1961.237) Organizational skills also 
pl^y an important role in the entrepreneur's success He is 
generally equally skilled as an administrator and as an expert 
in public relations. 

In conclusion, it has been said that "imitation is the 
highest form of flattery " In the case of research utilization, 
however, that saying might well be revised to "institution- 
alization is the strongest indicator of success " 

The Blueprint for Academic Achievement actually 
served to institutionalize the type of study that created much 
of the impetus for the Blueprint s initial development Trnt 
document's final section deals with "Evaluation as a Tool 
for Achievement Growth" and emphasizes that 

it will be important for the Office ,of Research and 
Evaluation to conduct follow-up studies which examine 
the effectiveness of various cnanges made to improve 
school ichi.vement The« Judies should look ai specific 
recommendations and compare various overall strategies 
implemented in schools This suggests lhai proposed 
changes should be implemented in a systemaiic way so 
that the effectiveness of different straiegies can be mea- 
sured and compared 
/ In the final analysis, however, institutional acceptance 
"is not entirely sufficient It is institutional demand for 
decision information that is perhaps the single most vital 
factor in the translation of research and evaluation into 
educational policy D 
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